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ABSTRACT 

We  study  computationally  feasible  solutions  for  a number 
of  problems,  related  to  a M/M/1  queue  in  which  the  arrival  and 
service  rates  vary  according  to  the  state  of  an  underlying 
Markov  chain. 

Our  results  may  be  used  to  model  the  effect  of  rush-hour 
phenomena  or  other  extraneous  fluctuations  on  the  characteristics 
of  an  M/M/1  queue. 
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I . Introducti on 


i 

[ 

i Consider  an  m-state,  irreducible,  continuous-parameter 

[ 

I Markov  chain  with  infinitesimal  generator  Q,  which  describes  a 

I randomly  varying  "environment"  for  a queue  of  M/M/1  type. 

if 

I Specifically  we  assume  that  whenever  the  Markov  chain  is  in  the 

1 state  j,  there  is  an  arrival  rate  A.  to  a single-server  queue 

and  a service  rate  u.,  with  A.>0,  m.>0,  l<j<m.  When  the  state 
( j j j ■ “ 

f of  the  Markov  chain  changes,  so  do  both  the  arrival  and  service 

I 

I rates.  This  model  was  introduced  by  U.  Yechiali  and  P.  Naor  [8] 

f and  further  investigated  by  U.  Yechiali  [9]  and  P.  Purdue  [7]. 

It  provides  a tractable  description  of  a simple  queue,  subject 
[ to  rush-hour  behavior  or  other  extraneous  phase  fluctuations. 

In  this  paper,  we  solve  the  M/M/1  queue  in  a random 
environment  by  an  approach,  which  leads  to  easily  impl ementabl e 
algorithms  for  the  numerical  computation  of  the  relevant  stationary 
j distributions. 

t 

[ By  2^  and  £,  we  denote  the  m-vectors  with  components  A.  and 

■ l<j<m,  respectively.  For  any  vector  we  introduce  the 

i 

[ matrix  A (£)  =d  i a g ( a -j  , . . . , a^^ ) . The  matrices  Aq,  A-j  and  A^  are 

defined  by  AQ=A(y^),  A-j  =Q- A (2^+^)  , A2  = a(^).  The  invariant 
1 probability  vector  of  the  matrix  Q is  denoted  by  i^and  is  the 

unique  solution  of  the  system  2t^Q  = 0,  with  jie  = l,  where  e=  ( 1 , 1 , . . . , 1 ) ' . 

The  queueing  model  of  interest  is  then  described  by  a 
continuous-parameter  Markov  chain  on  the  state  space 

isO,  l<j<m}.  The  chain  is  in  the  state  (i,j),  when  i 
customers  are  present  in  the  system  and  the  Q-process  is  in  the 
state  j.  The  infinitesimal  generator  Q*  of  the  chain  is  given  by 

- 
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and  is  of  a form,  studied  by  V.  Wallace  [10]  under  the  name  of 


quasi -birth-and-death  processes.  We  shall  show  that  the 
invariant  probability  vector  ^ of  the  matrix  Q* , if  it  exists, 
is  of  a matrix-geometric  form  and  may  easily  be  computed.  Before 
doing  so,  we  discuss  a number  of  other  points  of  independent 
i nterest . 

Lemma  1 

The  inverse  A-j  ^ exists  and  is  strictly  negative.  The 
matrices  CQ=-A”^Ag,  C2  = -A^^A2»  ^o”'^2^1^  ^ 

strictly  positive.  The  matrix  B=Bq+B2  has  a spectral  radius 
equal  to  one.  The  matrix  C=Cg+C2  is  stochastic. 

The  vectors  7t_  and  (lA-j  ^ A-j  £ are  respectively  positive 
left  and  right  invariant  vectors  of  B and  ttv  = 1 . 

The  vectors  li={iLAie)"\Ai  and  £ are  respectively  positive 
left  and  right  invariant  vectors  of  the  matrix  C and  ue=l. 

The  inequalities  u^(2C2e)<l  and  t;^(  2B2y^)  >1  , are  each  equivalent 
to  p = ( 3^)  (ivi)  ^ < 1 . 

Proof 

Since  the  matrix  Q is  irreducible,  the  matrix 

(2)  = -[Q-A(2^+i]_)]'^  = /”exp[Q-A(^+u)]t  dt, 

0 

is  strictly  positive  [1].  The  positivity  of  Bg,  B2,  Cg  and  C2  is 
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now  obvious. 


Since  ^ ( Aq+A^ +A2  )£=Qe  = 0 , it  readily 


follows  that 


( 3 ) irB  = ir  , 


I.A1  C=jlA]  > 


BAi  e = A-|  e , 
Ce  = e . 


Since  the  vector  Ty_  is  positive,  the  first  equality  in  (3)  shows 
that  the  spectral  radius  of  B is  one. 

The  inner  products  i£(2C2£)  and  £(262^)  are  given  by 

(4)  2 lu  C2  e = -2{tiI\2±)  (iA-ig)"^  = 2 tt^  ^ » 

2 JL  ^2  y_  = -2  ( Ti_AQe^)  ( ti_A^  e ) ^ = 2 

so  that  the  stated  inequalities  are  each  equivalent  to  p<l. 


II.  The  Busy  Peri od 


We  consider  the  queue,  starting  in  the  state  (i+l,j)  at 

time  t=0,  and  examine  the  first  passage  time  to  the  set  of  states 

l={(i.j'),  lij'sm}.  This  first  passage  time  corresponds  to  the 

familiar  busy  period  in  simple  queues. 

By  G..,(k,x),  k>l  , x>0,  1 < j , j ' <m , we  denote  the  probability 
J 

that,  starting  in  the  state  (i+l,j),  the  first  visit  to  the  set  i_ 
occurs  no  later  than  time  x,  into  the  state  and  exactly 

k service  completions  occur  during  the  first  passage  time. 

For  convenience,  we  introduce  -*  transforms 

(5)  G*  ,(z,s)  = y.  2^  r d G...(k,x), 

JJ  1^,1  0 

and  the  matrix  G* ( z , s ) = i G^  . , ( z , s ) } . 

>J  'J 
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The  first  passage  problem  under  consideration  is  of  a type, 
that  was  extensively  examined  by  the  author.  We  shall  only 
present  the  essential  points  here  and  refer  for  the  detailed 
proofs  to  [3]  and  [5]. 

Theorem  1 

The  matrix  G*(z,s)  satisfies  the  equation 

(6)  G*(z,s)  = z(sI-A^)'^Aq  + (sI-A^)'''a2 

for  s>0,  0<z<l . In  an  appropriately  defined  set  of  transform 
matrices,  G*(z,s)  is  the  unique  solution  to  (6). 

The  queue  is  stable  if  and  only  if  the  matrix  G=G*(1,0)  is 
stochastic.  The  matrix  G is  the  minimal  solution  in  the  set  of 
substochastic  matrices  to  the  equation 

(7)  G = Cq+C^G^. 

The  matrix  G is  stochastic  if  and  only  if  p<l  and  is  unique 
and  strictly  positive. 

Proof 

Equation  (6)  follows  from  a standard  first  passage  argument 
by  considering  the  first  time  that  the  queue  length  goes  either 
down  or  up.  The  other  statements  were  proved  in  [3],  where  it  is 
also  shown  that  G is  stochastic  if  and  only  if  the  inequality 
u^(2C2e)<l  holds.  From  Lemma  1,  we  know  that  the  latter  is 
equivalent  to  p<l.  This  is  also  the  equilibrium  condition 
obtained  by  U.  Yechiali  [9].  Equation  (6)  was  also  derived  and 
discussed  by  P.  Purdue  [7]. 

In  the  remainder  of  the  paper,  we  assume  that  p<l.  The  matrix 
G may  be  computed  by  successive  substitutions  in  Equation  (7).  We 
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shall  denote  the  invariant  probability  vector  of  G by  £ and  by  G 
an  nixm  matrix  with  identical  rows  given  by  2_. 

The  following  theorem  gives  explicit  expressions  for  the 
expected  duration  of  and  for  the  mean  number  of  customers  served 
during  a busy  period. 

We  define  the  vectors  and  by 


(8)  u* 


Is  ’ 

■^z  = l 
s = 0 


G*(z,s) 


z = l 
s = 0 


The  quantity  pt  is  then  the  expected  duration  of  a busy  period, 

3 

Starting  with  one  customer  and  with  the  Q-process  in  the  state  j. 

The  quantity  p°  is  the  expected  number  of  departures  during  such 
3 

a busy  period. 

Theorem  2 

If  P<1  , 

(9)  p*  = -{I-G  + G)[Q+A(A-i^)G]"^e. 

= - ( I -G+G ) [Q  + A (^-|^)  G] 

and 

(10)  2P*  = (Trp)'\l-p)"\  iP°  = (l-p)■^ 

If  P = l,  the  vectors  and  p^°  are  infinite. 

Proof 

The  formulas  (9)  can  be  obtained  by  particularizing  results 
in  [5],  but  as  the  proof  is  short,  we  repeat  the  essential  steps. 
By  routine  differentiations  in  (6),  we  obtain 


L 
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(n)  (A^+A2+A2G)ii*  = -e, 

2 

Since  I-G+G  is  nonsingular  and  since  also  Aq+A^G+A^G  =0,  we  have 
that 

(12)  (A^+A^+A^G) ( I-G+G )=Ag+A^+A2+(A^+2A2)G=Q+A(^-u)G, 

which  yields  the  formulas  (9).  In  [5],  it  is  shown  that  the 
matrix  in  (12)  is  nonsingular  if  p<l  and  becomes  singular  for  p=l. 
Finally,  the  formulas  (10)  follow  by  noting  that 

(13)  3_=a(I-G+G), 

iT[Q  + A(^-j^)G]  = (iTX-Tru)2_. 

The  formulas  (10)  provide  powerful  accuracy  checks  in  numerical 
computations . 

Corol 1 ary  1 

The  transform  matrix  corresponding  to  a first  passage  from  the 
set  of  states  i +r  to  the  set  of  states  i_  is  given,  for  r>l  , by 
[G*(z,s)]*'.  The  expected  duration  of  and  the  mean  number  of 
customers  initially  and  with  the  Q-chain  in  the  state  j,  are  given 
respectively  by  the  j-th  components  of  the  vectors 

(14)  y*(r)  = -(I-G'"+rG)[Q  + A(X-i^)G]‘^e, 

pO(r)  = -(I-G’'+rG)[Q  + A(x-M)G]"V- 

Proof 


The  first  statement  follows  directly  by  probabilistic 
considerations  [3]  and  by  standard  differentiations  we  obtain 
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(15)  ^*  ( r ) = y.  ( I -g'^  + tG  ) ( I -G+G ) 

v = 0 


and  similarly  for  ;^°(r) 


III.  The  Efrective  Service  and  Interarrival  Times 


In  this  section,  we  consider  the  probability  distribution  of 
a service  time  starting  at  time  t=0,  with  the  Q-process  in  the 
state  i.  This  will  be  called  the  effective  service  time  starting 
in  state  i.  The  results  for  the  effective  interarrival  times  are 
similar  and  will  be  stated  without  proofs. 

Let  ij;  — (v,t),  v>0,  t>0,  l<i,o<ni,  be  the  probability  that  a 
service,  starting  at  time  0 in  the  state  i,  lasts  for  a time  t at 
least  and  that  during  (0,t],  there  are  v^O  new  arrivals  to  the  queue, 
A direct  bi rth-and-death  argument  yields 

(16)  )(<]j(v,t)  = 6^.  j(-X^-y^+Q.^)il/^^(v,t)  + ^r_Q^.  j^(i/|^j(v,t) 

+ (l-6^o)Xi  j(v-l  ,t)  , 

for  t>0,  v>0,  l<i,j<m,  with  initial  conditions  il)^j(v,0)  = 
for  v>0.  By  6..,  we  denote  the  usual  Kronecker  delta. 

In  matrix  notation  we  obtain  the  recursive  system  of 
differential  equations 


(17)  (0,t)=A^.{.(0,t)  , 


ip  ' (v,t)=A^iJ;(v,t)+A2ik{v-l  ,t)  , 


for  v>l  . 


This  readily  leads  to 


(18)  iii*(z,t)=  y.  tj)  ( V , t ) z^  = exp[  ( A^ +ZA2  ) t] , for  0<z<l,  t^O. 
v = 0 


Formula  (18)  has  a number  of  useful  consequences,  which  we  i 

I 

combine  into  the  following  theorem. 

Theorem  3 

The  probability  that  a service,  starting  at  time  0 in  the 
state  i ends  during  (t,t+dt]  with  the  Q-process  in  the  state  j,  is 
given  by  the  (i,j)-th  entry  of  the  matrix 

(19)  exp[(A^  |■A2)t]AQdt  = exp{[Q-A(y)]t}A(y)dt. 

For  any  initial  probability  vector  y over  the  states  1 , . . . ,m  ; 

of  the  Q-process,  the  distribution  of  the  effective  service  time  is  ; 

a distribution  of  phase  type  [4]  with  the  representation  i 

Q-a(]£)].  Its  mean  is  given  by 

(20)  E^=x.[Ai^)-Q]'\. 

I 

The  probability  generating  function  p.j(z)  of  the  number  of 
arrivals  during  a service  starting  in  the  state  i is  given  by  the 
i-th  component  of  the  vector 

(21)  £.(z)  = /"  exp[(A.|+zA2)t]AQedt 

= [ ( 1 -z  ) A (_X  ) + A (t^) -Q] 

The  matrix  [a(]£)-Q]  ^a(i^)  is  stochastic  and  strictly  positive. 

Its  invariant  probability  vector  £*  is  given  by 

(22)  £*=(TTy)  V4(li)- 

If  the  state  i of  the  Q-chain  is  chosen  according  to  the 
vector  , the  corresponding  service  time  will  be  called  the  average 
effective  service  time.  Its  mean  E*  is  given  by  (iru)'^  and  the 

J 
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average  number  of  arrivals  during  it  is  given  by  £*£'(l)=p. 

Proof 

The  first  statement  follows  immediately  from  (18).  The 
effective  service  time  with  the  initial  probability  vector  ^ 
has  the  same  probability  distribution  as  that  of  the  time  till 
absorption  in  the  Markov  chain  with  infinitesimal  generator 

Q-a(;u) 

0 0 

and  initial  probability  vector  It  is  therefore  a PH- 

distribution  and  may  easily  be  computed  numerically.  The  expression 
for  the  mean  is  immediate.  [4] 

The  expression  for  £(z)  follows  directly  from  (18).  Since 
A (_u ) e-Q£=y_,  it  follows  that  the  matrix  [a(u^)-Q]  ^A(y^)  is  stochastic. 
That  Ti_*  is  its  invariant  vector  may  be  directly  verified. 

From  (21),  we  obtain  upon  differentiation  that 

(23)  E' (1  ) = CA(u)-Q]'^i, 
so  that 

(24)  £*£'  ( 1 ) = (ny_)  ^ A ( ]£)  [ A ( y_)  - Q]  ^A(e)  A ^ ( li)  ( I P.)  ^(]ll)  = P- 

A similar  calculation  yields  that  E*=(iTy)  \ The  interpretation 
of  p implied  by  (24)  was  first  pointed  out  in  [7]. 

The  corresponding  result  for  the  interarrival  times  are  as 
follows. 

Theorem  4 

Given  that  an  arrival  occurs  at  t=0  and  that  the  Q-process  is 
in  the  state  i,  the  probability  that  the  next  arrival  occurs  during 
(t,t+dt]  with  the  Q-process  in  the  state  j,  is  the  (i,j)-entry  of 


the  matrix 


1 0 


(25)  exp[(AQ+Ai  )t]A2dt  = exp[(Q-A(^))t]A(2L)dt. 

For  any  initial  probability  vector  y over  the  states 

the  effective  interarrival  time  has  a PH-distribution  with 

representation  and  mean  E^  = x[  A ( >^) -Q]  ” ^ e_. 

Given  an  infinite  supply  of  customers  at  t=0,  the  probability 
generating  function  of  the  number  of  departures  during  an 
interarrival  interval  starting  in  the  state  i,  is  given  by 

(26)  p^(z)  = [a(2^)  + (1-z)a(u)-Q]'\. 

For  ^ila(1)>  we  obtain  the  average  effective  inter- 

arrival time  and  the  mean  number  of  departures  during  the  average 
effective  interarrival  time  is  given  by  p”^  and  the  mean  duration 
of  the  latter  is  (ttX)"^. 

IV.  The  Steady -state  Queue  Length 

This  section  is  devoted  to  the  proof  of  the  following 
statements . 

Theorem  5 

If  p<l,  the  invariant  probability  vector  of  the  Markov  chain 
with  infinitesimal  generator  Q*  is  given  by  ( Xq ,^1  , . . . ) > where 

(27)  x^  = n(  I-R)r'^  , for  k>0. 

The  matrix  R is  the  unique  solution  in  the  set  of  nonnegative 
matrices  of  order  m,  which  have  a spectral  radius  less  than  one, 
of  the  equation 

(28)  R^Aq+RA^+A2=0. 


1 1 

The  matrix  R is  strictly  positive  and  t[^R<ti^. 

Proof 

The  invariant  vector  will  be  of  the  stated  form,  if  there 
exists  a matrix  R with  the  stated  properties,  such  that  (28) 
holds  and  there  exists  a vector  ^>0,  such  that 

(29)  XQ(Ag+A^+RAQ)=0. 

We  first  show  that  Xq=£(I-R)  and  we  shall  verify  below  that 
is  strictly  positive.  Equations  (28)  and  (29)  yield 

” o 

(30)  ^ XqR^(R^Aq+RA^+A2)  = 

v = 0 

Xq(I-R)"^ (Aq+A^+A2)=Xo(I-R)"^Q=0. 

Since  also  Xq  ( I -R ) ' ^ £=  1 , (30)  implies  that  Xq  = ti_(I-R). 

The  equation  (28)  may  be  written  as 

(31)  R=R^B2+Bq. 

Let  {R(n)}  be  the  sequence  of  matrices  obtained  from  successive 
substitutions,  starting  with  R(0)=0,  in  (31).  As  was  done  in  [6], 
one  may  then  verify  that 

(32)  R(n  + l)>R(n),  Ti_R(n)s2]^, 

so  that  the  spectral  radius  sp[R(n)]<l.  The  matrices  R(n) 
therefore  converge  to  a matrix  R,  which  is  strictly  positive, 
has  sp(R)<l,  and  satisfies  (31).  That  matrix  is  also  the  minimal 
nonnegative  solution  to  Equation  (31). 

By  repeating  verbatim  the  argument  given  in  [6],  Lemma  4, 
the  spectral  radius  n of  R is  the  smallest  positive  solution  of  the 
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equation 


(33)  z=x(z). 


Osz^l 


where  x(z)  is  the  Perron  eigenvalue  of  the  positive  matrix 

“ s 

Setting  z=e  , Equation  (33)  may  be  written  as 

(34)  s = -logx(e"^) , s>0. 

A theorem  of  J.F.C.  Kingman  [2]  guarantees  that  the  function 
logx(e  ^)  is  convex  for  ssO.  It  is  also  clearly  decreasing, 
negative  for  s>0  and  tends  to  the  finite  limit  log  sp(Bg)  as 
s-^“.  The  equation  (34)  has  the  solution  s = 0,  since  sp(B)  = l. 

There  is  a unique  positive  solution  Sg=-logn,  if  and  only  if 
x‘ (1-)>1 . 

A direct  calculation,  similar  to  that  presented  in  [6], 

Lemma  4,  yields  that 

(35)  x' (1-)=i(2B2)v, 

where  is  the  right  invariant  vector  of  B,  introduced  in  Lemma  1. 
It  follows  that  x'(1-)>1»  if  and  only  if  p<l  . 

So,  provided  that  p<l,  the  matrix  R has  spectral  radius  less 
than  one.  The  uniqueness  of  the  solution  R is  proved  exactly  as 
in  [6]. 

It  remains  to  show  that  iT_R<iy.  From  (32),  we  have  tt_R<tt_.  The 

2 

equations  i( Ag+A^ f A^ ) =0  and  k(R  Ag+RAi+A2)=0  imply  that 

? - 1 

(36)  Tt_- l]r_R  = - ( Tt_- £R  )Ag^] 


1 
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2 2 - 1 
Since  , but  and  the  matrix  -AgA^  is  strictly  positive, 

it  is  clear  that  the  vector  k(I-R)  is  strictly  positive. 

Remarks 

Theorem  5 has  a large  number  of  straightforward,  but  useful 
consequences.  Once  the  easily  computed  matrix  R is  known,  all 
moments,  marginal  and  conditional  densities  of  the  queue  length 
are  known. 

The  conditional  densities 
(37)  qi(j)  = 7,’^[n(l-R)R']j,  i>0, 

of  the  queue  length,  given  that  the  Q-process  is  in  the  state  j, 
shed  light  on  the  oscillatory  behavior  of  the  queue  length  in  the 
steady-state,  at  least  for  such  choices  of  the  parameters  which 
correspond  to  alternating  periods  of  high  and  low  traffic. 

V.  The  Steady -state  Virtual  Waiting  Time 

Assume  the  queue  in  steady-state  at  time  0.  Let  W.(x)  be  the 

J 

probability  that  a (virtual)  customer  arriving  at  that  time  will 
enter  service  no  later  than  time  x and  that  the  Q-process  will  be 
in  the  state  j at  the  beginning  of  his  service. 

It  is  easy  to  see  that  W.(x)  is  also  the  probability  that  in 
the  Markov  chain  with  infinitesimal  generator  Q , given  by 

W 


0 0 0 

a(];!.)  Q-A(u)  0 

0 A(u)  Q-A()£) 

(38)  = 0 0 A(y) 

0 0 0 


and  initial  probability  vector  >^=  ( 2^  , . . . ) with  X|^  = ti[(  I -R ) R , 

k>0,  absorption  into  the  set  of  states  0= {( 0 , 1 0 ,m ) } 
occurs  no  later  than  time  x into  the  state  (0,j). 

The  vector  W(x)  with  components  Wj(x),  Isj^m,  is,  in  general 
not  expressible  in  a closed  form.  The  vector  W * ( s ) of  the 
La  pi ace-S t i e 1 1 jes  transforms  of  W ( • ) is  given  by 

(39)  W*(s)=  5;  tt(  I-R)r''{[sI+a(w)-Q]"^a(p)}^ 


for  Re  s>0. 


The  time- in-! 


of  the  virtual  customer  arriving  at  time 


0 can  be  studied  in  the  same  manner.  Let  Wj(x),  with  Laplace- 
Stieltjes  transform  W t ( s ) , be  the  probability  that  a virtual 
customer  arriving  at  time  0,  leaves  the  system  (under  the  first- 
come,  first-served  discipline)  no  later  than  time  x with  the 
Q-process  in  the  state  j at  the  time  of  his  departure. 

By  using  the  results  obtained  for  the  distribution  of  the 
effective  service  time,  one  immediately  obtains  that 


(40)  W*(s)=W*(s)[sI+a(u)-Q]"'a(m) . 


Computation  of  W(*)  and  W(*) 


Although  W ( • ) and  W ( • ) are  not  tractable  in  a convenient 
analytic  manner,  they  can  easily  be  computed  as  follows. 

For  W ( • ) » we  form  the  infinite  system  of  differential 
equations 

(41  ) y.,|,(x)=y.,^(x)[Q-A(M)]+y^l^^^  (x)a(u)  , 

for  k>l , x>0,  with  the  initial  conditions 
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(42)  i^^(0)  = ^I.(I-R)R^  k>l. 

For  every  x>0,  the  vector  W(x)  is  then  given  by 

(43)  W(x)=i(  I-R)+/^  y.1  (^)duA(p)  , 

0 

and 

00 

(44)  W(x)e=l-  T.  y..(x)e. 

k = 1 " 

Remarks 

a.  If  only  W(x)e^  and  not  W(x)  is  to  be  computed,  there  is  a 

00 

slight  gain  in  efficiency  by  solving  for  the  vectors  Y.(x)=  i ^ (x), 

V-  K 

after  modifying  the  system  (41)  in  the  obvious  manner.  The 
summation  in  (44)  is  then  eliminated. 

b.  The  Markov  chain  Q can  only  move  towards  lower  states.  It  is 

w 

therefore  obvious  how  to  truncate  the  system  of  differential 
equations  (41).  In  order  to  lose  at  most  a probability  mass  e in 
tail  of  the  probability  distribution  W(x)£,  one  truncates  at  the 
index  K such  that 

(45)  iR'^'^^e=  5:  £(  I-R)R^e<E. 

v=K+l 

This  bounds  the  error  due  to  truncation  of  the  infinite  system. 

The  global  error  involved  in  solving  the  resulting  finite  system 
of  differential  equations  needs  to  be  considered  separately. 

c.  The  vector  W( • ) can  be  evaluated  by  solving  the  system  (41) 
with  the  initial  conditions 

(46)  y.,^(0)  = TL(  I-R)r’'"’ , for  k>l. 


Formula  (40)  also  leads  to 


r 
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(47)  W' (x)+W(x)a‘^  (u)[Q-A(m)]a(p)=W'  (x)A(y)  , 
for  x>0,  with  W{0)=£. 

d . The  quantities  W*(0)  and  Wt(0)  give  respectively  the 

J -j 

probability  that,  in  the  stationary  queue,  a customer  will  enter 
service  with  the  Q-process  in  the  state  j and  will  depart  the 
system  with  the  Q-process  in  the  state  j. 

These  quantities  can  be  used  in  specific  examples  to  obtain 
measures  of  the  amount  of  spill-over  from  a rush-hour  into  the 
subsequent  periods  of  lower  traffic. 

VI.  Some  Applications  and  Problems  for  Further  Investigation 
A.  Rush-hour  Phenomena 

In  a simple  description  of  an  alternating  sequence  of  rush- 
hours  and  quieter  periods,  we  construct  the  Q-matrix  as  follows. 

Let  Fi(*)  and  F2(*)  be  PH-di stri butions  on  (0,“)  with 
representations  (a-j  ,Ti  ) and  respectively  and  with  means 

Kl  = -aiT^^^  and  K2=-a2^2^— ’ assume  without  loss  of 

generality  that  the  matrices  T.|+T|A(a.|)  and  T2  + T2A(a2)»  orders 

m.|  and  m2  respectively,  are  irreducible.  As  usual  in  discussions 
of  PH-di stri buti ons  T^  and  1°  are  matrices  with  identical  columns 
given  by  the  vectors  T^  = -T.|e  and  T2  = -T2e,  respectively.  The 
stationary  probability  vectors  of  T^+T^a(o^)  and  T2  + T2A(a2)  3*"® 
respectively  denoted  by  ti_^  and  ^2  [^1- 


There  is  now  a convenient  way  of  formalizing  the  alternating 
renewal  process  with  underlying  distributions  ( • ) and  F2(’). 

We  form  the  Q-matrix 
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(48)  Q= 


T^A(a^  ) 


T°A(a2) 

To 


With  a slight  abuse  of  notation,  T°  is  here  an  m^xtn^  matrix  with 
m2  identical  columns  given  by  T°.  Similarly  for  T°. 

The  Q-matrix  now  defines  a Markov  chain  with  m=m^+m2  states. 

If  the  chain  is  in  any  one  of  the  states  l,...,m-|,  an  interval  of 
the  first  type  is  "in  course"  in  the  alternating  renewal  process. 
With  the  chain  in  one  of  the  states  m-j +1  , . . . .m-j +m2 , the  alternating 
renewal  process  is  in  an  interval  of  type  2. 

It  is  elementary  to  verify  that  the  stationary  probability 
vector  TT  of  Q is  then  given  by 


(49)  , <2—2^  ’ 

where  Kj=Ki(Ki+K2) 

We  can  now  model  a rush  hour,  by  assuming  e.g.  that  X.  is 
large  for  l<i<m^  and  small  for  m^ +1 <i <m^ +m2 . The  parameters  u. 
can  either  be  independent  of  i or  can  be  chosen  in  some  judicious 
way.  This  leads  to  an  interesting  problem  in  non-linear 
optimization,  which  we  formulate  next. 

B.  Rush-hour  Control 

There  is  a whole  class  of  interesting  nonlinear  optimization 
problems  associated  with  the  choice  of  the  service  rates 
l<i<m,  for  the  model  described  above.  We  may  e.g.  endeavor  to 
choose  the  rates  subject  to  certain  cost  constraints,  so  that 
the  conditional  mean  queue  lengths 
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(50)  irj^[l(I-R)  ^]j,  Isjsm, 

vary  only  little  with  j.  This  would  be  one  of  many  ways  of 
smoothing  the  queue. 

An  interesting  partial  result  arises  from  the  tractable 
special  case,  noted  by  Yechiali  [9].  In  our  notation  and  in  a 
slightly  refined  form,  we  obtain  the  following. 

Theorem  6 

In  the  particular  case,  where  X.=py.,  for  l<j<m,  with  p<l, 

J J 

the  equation  (31)  may  be  written  as 

(51)  R=R^D+pD, 

with  D = A ()£)[(  1 +p ) A (jj^) -Q] 

The  matrix  R is  then  given  explicitly  by 

(52)  R=1  E 

v=  1 

The  matrix  D satisfies  i^D=(l+p)”\,  so  that  (52)  implies 
that  £R=pTi^, 

The  invariant  probability  vector  x of  Q*  is  then  given  by 

(53)  X|^=  ( 1 -p  ) p*^2L’ 


Proof 


In  this  case,  one  sees  by  direct  substitution  that  the 

equation  (51)  has  the  same  formal  solution  as  the  scalar  equation 
2 

r=r  d+pd.  The  series  (52)  is  the  matrix  analogue  of 


(54) 


r= 


Yd 


l-(l-4pd^) 


_ 1 / V .2v-l 

= p-  I ( ) p d 

v=  1 


I 


1 

I! 
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The  remaining  statements  are  easily  verified. 

The  qualitative  interpretation  of  Theorem  6 is  clear.  If 

the  server  can  produce  a service  rate  y-=p  whenever  the 

J J 

arrival  rate  is  x.,  the  stationary  queue  length  distribution 

J 

will  be  independent  of  the  state  of  the  Q-process.  This  ideal 
smoothing  of  the  queue  may  however  be  infeasible  in  practice. 

The  server  may  not  be  able  to  serve  at  rates  higher  than  a given 
value  of  u,  or  cost  considerations  may  make  such  a high  flexibility 
in  the  service  rate  prohibitive. 

We  do  not  pursue  these  topics  here.  It  is  important  to 
emphasize  however  that  there  is  no  hope  of  obtaining  tractable 
analytic  solutions  for  this  type  of  problem  in  view  of  the 
complicated  nonlinear  dependence  through  R of  the  quantities  in 
(50)  on  the  parameters  of  the  problem.  A combination  of  computational 
experience  and  techniques  from  nonlinear  optimization  on  the  other 
hand  appears  to  be  promising  and  will  be  discussed  elsewhere. 

C.  Interruptions  of  Arrivals  or  Services 

By  setting  some  of  the  parameters  x^.  and  equal  to  zero, 
we  can  model  interruptions  of  arrivals  or  services  during  random 
intervals  of  time. 

In  the  main  body  of  the  paper,  we  have  assumed  that  all  X^ 
and  are  positive  in  order  to  avoid  consideration  of  particular 
cases.  This  assumption  can  frequently  be  relaxed  in  an  obvious 
manner  for  each  theorem.  Provided  that  at  least  one  of  the 
parameters  x^  or  pj  is  positive,  the  matrix  A^^  remains  strictly 
negative.  When  some  of  the  arrival  or  service  parameters  are 
zero,  some  of  the  matrices  Bq,  B^,  Cq  and  acquire  rows  or 
columns  which  are  identically  zero  and  some  of  the  statements 
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regarding  the  matrices  G and  R need  to  be  modified. 

For  purposes  of  illustration,  we  consider  the  case  of  service 
interruptions.  We  assume  that  X.>0,  for  l^j<m  and  u.>0,  for  Isjsm,, 

vJ  J ' 

vi^.  = 0,  for  m^+l<j<m,  with  l<mi<m.  In  this  case  the  matrix  Bg 
remains  strictly  positive  and  Theorem  5 continues  to  hold  as 
stated.  The  statements  regarding  the  busy  period  require  changes, 
since  no  busy  period  can  now  end  when  the  Q-process  is  in  one  of 
the  states  mi+l,...,m.  In  terms  of  the  equation  (7),  we  see  that 
the  columns  labeled  m^+l,...,m  of  Cg  are  now  identically  zero. 

We  see  that  this  is  also  the  case  for  the  matrix  G*(z,s)  and 
therefore  also  G. 

A complete  discussion  of  the  busy  period  requires  that  we 
show  that  Equation  (6)  has  a unique  solution  with  the  first  m^ 
columns  strictly  positive  and  the  other  columns  equal  to  zero. 

The  proof  of  this  and  of  the  corresponding  moment  formulas 
of  Theorem  2 is  fully  analogous  to  the  irreducible  case  [5],  but 
requires  more  tedious  steps  as  we  need  to  partition  the  matrix 
G*(z,s)  into  the  form 

G*(z,s)  0 

9 

G*(z,s)  0 

where  G^(z,s)  is  m-jxm^  and  G*(z,s)  is  (m-m^)xm2. 

If  also  some  Xj  are  zero,  the  matrix  R will  have  the 
corresponding  rows  equal  to  zero.  The  form  of  the  vector 
given  in  Theorem  5 remains  valid,  but  the  proof  of  the  existence 
and  uniqueness  of  R requires  greater  care  and  a consideration  of 
cases . 


I 


t 


! 
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D,  Some  Comments  on  Numerical  Computations  j 

Even  in  the  case  m=2,  the  matrix  R cannot  be  obtained  in  an  j 

i 

explicit  form,  but  its  numerical  computation  is  straightforward.  ' 

1 

I 

Successive  substitutions  in  Equation  (31)  exhibits  very  rapid  ; 

convergence,  except  for  cases  where  p is  close  to  one.  Computations  , 

for  problems  with  m as  large  as  one  hundred  are  entirely  feasible  ^ 

and  stable. 

The  approach  to  numerical  computations,  described  in  [9], 
should  however  be  applied  with  caution  as  it  involves  the  compute-  I 

tion  of  the  roots  of  a polynomial  equation  in  the  unit  interval. 

Knowledge  of  these  roots  permits  the  computation  of  the  vector 
)^Q,and  the  vectors  , k>l,  can  then  be  recursively  computed.  If 
the  roots,  discussed  by  Yechiali,  are  close  together,  however  the 
computation  of  and  therefore  of  the  vectors  , k>l  , is  likely 
to  be  of  doubtful  accuracy. 
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